Circuit arrangement for analog-to-digital conversion of magnitudes or signals in electrical form

ABSTRACT

Apparatus for converting analog electrical signals to a digital electrical signal wherein the statistical probability of a predetermined state for the digital output signal is a predetermined function of the analog input signals to provide digital signals having improved transmission capabilities. A continuously varying threshold electrical signal having a predetermined statistical distribution of amplitudes is compared to the analog input signal and the result of such a comparison is used to produce and control the digital output signal such that the statistical probability of a given digital state is a predetermined function of the analog input corresponding to the predetermined statistical distribution of amplitudes of the continuously varying threshold signal.

United States Patent 1191 Wehrmann Sept. 24, 1974 CIRCUIT ARRANGEMENT FOR ANALOG-TO-DIGITAL CONVERSION OF MAGNITUDES OR SIGNALS IN OTHER PUBLICATIONS Poppelbaum et al., Stochastic Computing Elements ELECTRICAL FORM and Systems, AAPS Conference Proceedings, 1967, [75] Inventor Wolfgang Wehrmann Vienna Fall Jomt Computer Conference, pp. 635/644.

. Austria Quarterly Technical Progress Report, Jan.-Feb- .-March, 1965, Dept. of Computer Science, Univ. of [73] Assignee: Norma Messtechnik Gesellschaft Illin i 25-33,

Vlenna Austria Quarterly Technical Progress Report, Oct-Nov.- [22] Filed: July 31, 1972 Dec., 1965, Dept. of Computer Science, Univ. of Illi- 21 Appl. No.: 276,385

Primary Examiner-Felix D. Gruber [30] Forelgn Apphcatlon Prlonty Data Attorney, Agent, or FirmCushman, Darby &

Aug. 3, 1971 Austria 6780/71 cushman [52] US. Cl..... 340/347 AD, 235/1503, 235/150.5,

307/260, 307/269, 328/59, 328/63 ABSTRACT [51] Int. Cl. H03k 13/02 A t pparatus for convertmg analog electrical slgnals to a [581 3 5 75 5 digital electrical signal wherein the statistical probability of a predetermined state for the digital output sig- 2 nal is a predetermined function of the analog input signals to provide digital signals having improved [56] References cued transmission capabilities. A continuously varying UNITED STATES PATENTS threshold electrical signal having a predetermined sta- 3,180,939 4/1965 Hall 340/347 AD tistical distribution of amplitudes is compared to the 3,349,390 10/1967 Glassman 340/347 AD analog input signal and the result of such a compari- 3,404,26I 10/1968 Jespers et al. 235/181 on is usgd to produce and control the digital.output 3,419,819 12/1968 179/15 AP signal such that the statistical probability of a given i i digital state is a predetermined function of the analog 3530459 9/1970 input corresponding to the predetermined statistical atelon 179/15 AP f d f h l 3,612,845 10/1971 Lawlor 235/1503 dist" ampm 65 0 t e ntmu0usy Van/mg 3,725,677 4/1973 Lawlor 328/59 threshold slgnal- FOREIGN PATENTS OR APPLICATIONS 15 Claims, 32 Drawing Figures 1,184,652 3/1970 Great Britain 235/1505 Camp wr/aan/bec/s/an J 00/2 tramp/m [,ggggg 3 42 22.5032

em] 2(1) i 201 2 8 6 a I I Sea n Deacctor t L-T ys;

I 71 1 l I l I TZrmMo/a re/ue Ge'nera I or SJ/WC Generwzor SHEEI 1 BF 7 FIG! Pmmeu www 3.888.413

SHEET s BF 7 Shams-61c Tires/20M Generator N I Sea/mam PATENTEDSEPZMHH SHEH 6 OF 7 CIRCUIT ARRANGEMENT FOR ANALOG-TO-DIGITAL CONVERSION OF MAGNITUDES OR SIGNALS IN ELECTRICAL FORM The invention concerns a circuit arrangement for analog-digital conversion of electrical magnitudes or signals by means of threshold-value controlled comparison and decision units and associated threshold-value generators.

Devices for analog-digital conversion are known. The presently most modern kind of analog-digital conversion rests on pulse code modulation (PCM). Examples will be found in the German AUSLEGESCHRIFTEN 1029711. 1939975. 2036557. 2040339 and 2041077 and in the French Pat. 6926970. PCM is a process widely used in many branches of electronics, in which quantized analog measured values are converted into the bindary code. Thus all the advantages of the hind ary code are being made use of. This requires increasing the time scale of the binary signal by the selected number of bits per analog value and the bit groups must be properly recognized and assessed. If one bit in the group is subject to interference or incorrectly valued, the error may affect almost the entire scope of the measurements. Hence synchronization is a central and ticklish problem for the PCM process. In addition, there is fairly high expenditure in the modulators and demodulators that are required. particularly if the formation of the characteristics of the input signals is related to the analog-digital conversion.

Another drawback in analog-digital conversion is that because of the different bit values, PCM interferences are percentagewise more pronounced for small analog values than for large ones.

Aside from PCM, the pulse frequency processes such as in the Austrian Pats. 254.973, 260.345, 275.649, 278.159 and 283.490. or in the German Auslegeschriften 1011.327, 1022.127. 1028.469, 1029.711, 1062.583. 1122.417. 1288.488 and 1762.570 may be considered as being of the state of the art. Common to all pulse frequency processes is that the pulse frequency is unambiguously related to the measured value and that each change in measurement causes a corresponding change in pulse frequency. Thus a given frequency range is associated with a given range of measurements. The required frequency range is determinedby the desired accuracy of conversion, the converters frequency stability and the magnitude of the interferences. Associating measured values with pulse frequencies can be achieved in several ways. When measuring rotating parts. the transmitters generate continuous pulse series as a function of angular speed with variable pulse frequency. In other processes. RC circuits of astable multivibrators are controlled as a function of the measured value, so that a functional relationship is obtained between measured value and pulse frequency. Aside from transmitter problems. the pulse frequency process suffers from two drawbacks per se and of es sential nature:

First. the pulse signals power spectrum changes as function of the measured value and hence its required bandwidth within wide limits. This increases synchronization problems and interference difficulties in signal transmission and entails higher costs.

Second the frequency constant of the measuredvalue converter is wholly absorbed in the accuracy of measurement.

The object of the invention avoids these said drawbacks of the known processes and allows analog-digital conversion of magnitudes and signals in a new and advantageous manner.

The invention essentially consists in providing a combining network in a circuit such as initially mentioned, in that each comparison and decision unit comprises an ergodic converter (ergodic conversion is also explained in my allowed copending US. Pat. application No. 276,315, filed July 31, 1972, the disclosure of which is hereby incorporated by reference and in that the threshold-value generators are provided with output potentials with predetermined amplitude frequencies of occurrence, (i.e.. a predetermined statistical probability distribution of the possible amplitudes) where a binary pulse sequence or series with a pulse or pulse-length frequency of occurrence related to the signalcharacteristics appears at the output of the combining network.

This kind of embodiment provides the following advantages with respect to conventional kinds of analogdigital conversion: high immunity to interference, high discrimination effectiveness with respect to noisy analog values, complete immunity to bit frequency fluctuations and synchronous or asynchronous analog value recovery.

The drawing illustrates the invention by means of examples of execution and in diagrammatic form. FIG. 1 shows a block diagram of the principle of the invention for a circuit arrangement and FIGS. 2a and 2b show the associated signals with time; FIGS. 30 through 3d show further signals as functions of time for the elucidation of the operation of the circuit arrangement; FIGS. 4a through 4e show further circuit arrangements or modifications in the circuit of FIG. 11 and FIGS. 5a through 50 are diagrams explaining signal processing with those arrangements; FIG. 6 is an additional measurement arrangement for digital display of the result. FIG. 7a shows a combination of two circuit arrangements according to FIG. 4b into a new arrangement and FIGS. 7b through 7e show variations of same; FIG. 8a shows a circuit arrangement for the analog-digital conversion of roots from time averages and FIG. 8b shows a variation of same; FIG. 9 is a circuit arrangement for the analog-digital conversion with functional formation of quotients of time averages. FIG. 10 is a circuit arrange ment for binary representation of the correlation coefficient. FIGS. 111a and 1112 show circuit arrangements for analog-digital conversion with functional formation ofthe DC value, and FIGS. through 12d show associated diagrams for the explanation of signal processing; FIG. 13 illustrates a circuit arrangement for the analog-digital conversion of signal transforms.

The circuit arrangement shown in FIG. 1 comprises a detector 1 transmitting for instance a magnitude m(r) such as a force, acceleration potential, current or any other mechanical, optical, acoustic or electrical magnitudes. The general-case physical magnitude m(t) is transduced into an electrical magnitude e(r) by means of a transducer 2 and is fed in this form to a thresholdvalue controlled comparison and decision unit 3. The latter compares the magnitude e(t) with the thresholdvalue v(r), which is generated by the threshold-value generator 4, and the decision is made, for which value of t the inequality (1) will be satisfied,

e(t) 2 v(t) FIGS. 2a and 2b explain the corresponding decision and comparison process for the simplifying assumption that e(t) E, a constant potential and that v(t) s(t), a saw-tooth potential. FIG. 2a shows the time-course of the saw-tooth potential s(t) with its maximum value S and the time-invariant magnitude E. For the assumptions of FIGS. 2a and 2b, the potential level U will appear at the output of function unit 3 as long as E 2 s(t) is satisfied, otherwise the potential level U will. If according to FIG. 2b, the potential U is associated with the state logic 1 and the potential U, with the state logic 0, then a function z(t) will appear at the output of unit 3, which may be mathematically described as a sequence or series of the states logic 1 and 0." Below the states logic 1 and logic 0 for the sake brevity will be termed states 1 and states 0. The series z(t) is concretely related with inequality (2) corresponding to FIG. 2b and consists of a periodic sequence of states 0 and l. The relative frequency of occurrence of state 1 in z(t) is directly proportional to the value t,;. For sufficiently long time of observation, and in the sense of probability theory, the relative frequency of occurrence for proper accuracy of measurement is equal to its corresponding probability. FIG. 2a readily shows that the frequency of occurrence of state 1 in z( t) is proportional to the time r and therefore the probability of state 1 in z(t), namely p(Z.=1 may be computed from which provides the direct proportionality between the probability of state 1 and the value E.

In the sense of information theory, the function z(t) is an electrical binary signal with all the advantages of binary signal shapes or forms. A binary signal z(t) appears at the output of unit 3, which satisfies eq. (4) for the relations shown in FIG. 2b,

M, Sn;

where M is the time-average of the series z(t). Then one further obtain M/S t /t E/S so that M is identical with E. In summary therefore, the circuit arrangement of FIG. 1 associates a binary series z(t) with a constant analog value E, where the timeaverage value of z( t) is proportional to the probability p(Z.=l) and hence to the magnitude E. This kind of circuit arrangement according to the invention therefore acts as an analog-digital converter delivering a binary signal z(t) from which the measured value may be particularly easily recovered in analog fashion and which further is provided with high immunity to interference as compared to the binary signal in conventional analog-digital converters. This immunity is related to the already mentioned conversion of the analog value into a state probability of the binary signal z(t). In this kind of analog value conversion the interferences will be the less effective, the more pulse events in z(t) will be used in the recovery of the analogous value. It is seen from the fairly simple mathematical assumptions that the linear relationship between the probability p(Z.=l) and the value E comes into being because of the linear saw-tooth curve. Mathematically this is equivalent with a constant amplitude spectrum or distribution function of a saw tooth potential. Besides the saw-tooth potential, there are arbitrarily many other functions with a constant amplitude frequency of occurrence distribution and which obviously would also apply to the above considerations. An example is the potential s'(t) in FIG. 3a and the corresponding shape of the series z(t) in FIG. 3b. Nor need the threshold-value potential v(t) be a periodic function. One may conceive the threshold-value potential v(t) as being made up of partial sections of different saw-tooth potential segments amounting to a resultant curve s"(t) which only eq. (3) must satisfy at all times This is shown by FIGS. 30 and 3d.

For the case of signal processing according to FIGS. 3a and 3b, eq. (3) will be valid for and if according to FIGS. 3c and 3d, in the form P( E Eij m' Lastly, a stochastic generator too may be used for generating threshold-value potentials, where the stochastic output signal v(z) is of constant amplitude spectrum.

When FIG. 1 was explained, an analog-digital conversion was described which was particularly meant for the analog recovery of E.

Another form of the binary signal z(t) is better suited for the recovery in digital form of the measured value E. Since according to eq (3) the value of E is proportional to the probability of occurrence of the state logic I in z(t), namely p(Z.=l), the digital recovery of E amounts to a digital measurement of the probability p(Z.=l). In order to ensure this, unit 3 in FIG. 1 may be modified according to FIG. 4a to unit 3' and be provided with a synchronous generator 7, with a converter 8 and with a scanning network 6 comprising a conventional triggered sampling network as will be appreciated. Then the series z(t) will be scanned at trigger T from synchronizing generator 7. Then the scanned or sampled values z(t where k 0.1 form a binary pulse series of which the relative pulse frequency of occurrence is proportional to E. FIG. 4b shows a variation for the generation of the binary pulse sequence z(t The signal processing associated with FIG. 4b will be explained with the help of FIGS. 5a through 50 and with respect to a stochastic threshold value potential v(t) generated by generator 4'. FIG. 4b shows the detector l which provides the measured value m(t) that p(v), and generally may be expressed as will be converted into an electrical magnitude e(t) in transducer 2. The following threshold-value controlled comparison and decision unit 3 comprises the converter 8 which is fed from the magnitude e(t) or in special cases from E, from the threshold-value potential v(t) delivered by the stochastic generator 4' and from the synchronizing generator 7, as shown in more detail in FIG. 40. Therefore the comparison and decision process in unit 3" occurs at discrete trigger times t determined by the synchronizing clock generator 7. In order to simplify electronically the comparison and decision process, the potential v(t) is biased by means of a sufficiently large DC potential V, so that only decisions regarding one polarity are required. This previously mentioned bias for the sake of simplicity will further below also be denoted by v(t) and is shown in FIG. 5a. Unit 3 compares the magnitude of E with the potential v(t) only at trigger times t,,. This means with respect to signal processing that the magnitude E will be compared with the threshold-value potential at the trigger times, that is with v(t as shown in FIG. 5b. Then unit 3 will make decisions in the form of pulses or pulse-gaps at the times of triggers. A pulse will always appear at the output of unit 3 if the threshold-value potential v(t) is less than E at a trigger time, otherwise there will be a pulse-gap. The pulses and pulse-gaps at the output of unit 3 form a binary random series z(t which is shown in FIG. 5c. If the pulse event is associated with the state logic I and the event of pulse-gap with the state logic 0, then the relative frequency of occurrence of the pulses in z(t will also indicate the relative frequency of occurrence of the state logic in z(t,,). Similar considerations apply to the association of pulse gaps and state logic 0. Again, in the sense of the theory of probability, a relative frequency of occurrence such as that of state I in z(t for appropriate accuracy of measurement and sufficient length of observation will be equal to the corresponding probability p(Z.=l ;r=r,,). It will be shown next that for the case of signal processing of FIGS. a through 50, there is a linear relationship between the probability p(Z.=l;t=t and E. This is best shown by two limiting cases.

If the value of E is so large that it exceeds v(t) everywhere, then unit 3" will deliver only pulses at the trigger times t and the series z(t,,) will consist solely of logic l-decisions. In other words, the state 1 will occur in the series z(t at those trigger times with probability p(Z.=l;t=t 1. If on the other hand the value of E is so small that at every trigger time v(t) exceeds E, then the series z(t will consist solely of zerodecisions, that is, the probability for state 1, p(Z.=l; t==t,,) is zero. If E lies between the two above values, then there will be a number of logic 0 and l decisions depending on the value of E in the series of z(t,,). This number of l-decisions and therefore its relative frequency of occurrence rises with the value of E, thus is a function of it. For the case of a stochastic thresholdvalue potential v(t) with constant amplitude spectrum, this dependency is linear as will be shown by the brief ensuing mathematical considerations. The probability of a pulse in z(t p(Z:=l ;t=t besides the value of E also depends also on the amplitude frequency of occurrence of the threshold-value potential v(t), namely of Under the assumptions of the object of the invention that there is a constant amplitude spectrum, one obtains p(v) l/H constant.

Therefore eq. (8) will yield,

P( k) E/H This provides the value E/H and indicates the linear relationship between the probability for state I in the series z(t at the trigger times, on one hand, and the value E on the other.

The binary series z(t is a pulse series in which, as explained above, the probability of a pulse, p(Z:l ;t=t,,-) is proportional to E. This form of converting an analog value E into a synchronized binary sequence z(t,,) is particularly suited for digital recovery of E from the sequence z(t by means of digital measurement of the probability p(Z.=l ;t=t This measurement is shown in principle in FIG. 6 which illustrates its simplicity. The sequence z(t,,) is fed into the measurement input f, and trigger Tinto the normalfrequency input f of a digital counter 9. The counter display 8 is a direct measure of the probability p(Z:=l;t=t and therefore of the value E. FIG. 4d shows a further variation 3" for the threshold-value controlled comparison and decision unit 3, and FIG. 4 e a variation of the threshold-value generator 4.

In the modification shown in FIG. 4d the electrical input AC magnitude e(t) is fed to a sampling network 6 which is clocked (triggered) by a clock generator 7. The sampled values of e(t) thereby generated are fed from the output of sampling network 6 to a converter 8 in which they are being compared with a varying threshold signal v(t) with respect to their amplitude, and which converter thereby generates a binary random sequence z(t Sampling network 6, clock generator 7 and converter 8 together form a modified comparison and decision unit 3' being controlled by input magnitude e(t) and threshold signal v(t), and delivering at its output the binary random sequence z(t FIG. 4e shows a modification of the threshold signal generator which includes a stochastic generator 5, the output signal v(t) of which is fed to a sampling network 6. Sampling network 6 is clocked (triggered) by a clock generator 7 and delivers sampled threshold values v(t at its output. Stochastic generator 5, sampling network 6 and clock generator 7 cooperate in the manner described and together form a threshold signal generator 4'.

Eq. (8) shows the influence of the amplitude spectrum of the threshold-value potential v(t), namely p(v), on the functional relationship between E and probability p(Z:=l;t=t Upon integrating as below, one obtains definition, P(tl I), so that from eqs. (8) and (9), one obtains,

The probability spectrum P(v) thus acts as the transform for E. This circumstance may be put to use for certain characteristic of measurements.

In the sense of probability theory, the periodic functions too have probability spectra. These correspond to the inverse functions of the periodic functions. Thus even complicated characteristics may be achieved, provided the inverse function be simple. This applies for instance to the logarithm or the root formation, where the inverse functions are resp. the exponential and the parabola. If the assumption made so far no longer is satisfied, namely that E is constant, and if the measured value e(t) is time varying, as shown in FIG. 1, then two cases must be distinguished for the analog-digital conversion of this invention. In the first case the fluctuations in e( t) are so slow compared to the time-values r and t,,, from eq. (7) and FIG. 3d, that the measured value e( t) can be considered quasi-constant during the time of measurement t with respect to the probability p(Z:=1) or P(Z.=l;t=t Applied to the case of signal processing as in FIGS. 3 and 5, this means that for periodic threshold-value potentials v(t), sufficient numbers of periods must have elapsed, and for stochastic threshold-value potentials v(t), enough time must have elapsed, in the synchronized case according to FIG. 4a through 4d enough triggers must have elapsed, in order that the probabilities p(Z:=l) or p(Z.=1;r-r,,) may be determined with appropriate accuracy of measurement from the series z(t) or z(t These probabilities synchronously fluctuate with the measured value e(t). Thus the probabilities p(Z:=l or p(Z.=l ;t=t are proportional to the instantaneous values of e(t), where, as already mentioned, the fluctuations in e(t) are so slow that e(t) is quasi-constant during the measuring time At,,,, and thus will satisfy the equation below within the scope of instrument accuracy,

e(t) e(t Al,,,)

This limitation is quite feasible in today s remote control and measuring techniques and does not hamper the application. these restrictions drop out for rapidly changing values e(t) when only such given characteristics as DC value, DC component, effective value and other signal characteristics are required to be digitally converted in the sense of this invention.

For the assumptions so far of a constant E of a quasiconstant measured value, it was shown that binary random series may be associated with an analogue value, where the probabilities or the occurrence of state 1 are proportional to a constant measured value or to the instantaneous values of a changing measured value. One may also make use of the arrangements shown in FIGS. 1, 4a and 4b for rapidly changing values e(t), if the analog-digital conversions of the latters characteristics are concerned. Then a binary random series will be produced each time, for which the probability of occurrence of the logic state 1 is proportional to the particular signal characteristic. This will be shown by five examples. For reasons of simplification already mentioned it will be assumed that the measured values too have been biased by the same amounts and that there- LII fore only decisions with respect to one polarity are required. The first example will deal with an analogdigital conversion for the case of a linear average or DC value of a measured value e(t), when synchronized pulses series are being used with a constantly distributed threshold-value potential v(t).

Starting with the circuit arrangement of FIG. 4b, then one may express eq. (8) in a modified form for rapidly varying magnitudes e(t) The relationship of eq. (12) indicates that the probability of a pulse event at time t in the series z(t is proportional to the instantaneous value E of e( t) at that moment. The measurement of a probability may only be effected by observing the relative frequency of occurrence over a sufficiently long time, and in this case, by observing the pulse frequency over many triggers. Then one obtains a value p which is averaged over k for the probability p(Z:=l;t=t namely which, for sufficiently large N and adequate accuracy of measurement, will provide the probability of a pulse in z(t p Then in the limit the value of p becomes Except for a multiplicative constant, this value is the time average e(t), or the linear average or DC value of e(t). This relationship holds for deterministic as well as for stochastic signals e(t). To round out the plausibility of this result, it will be observed that each amplitude of a stationary stochastic signal will occur with a relative frequency corresponding to its probability over a sufficiently long time of observation. The averaging in eq. 13) extends over these relative frequencies. In summary, one may state:

If the circuit arrangement of the invention such as in FIG. 4b is controlled with a rapidly varying magnitude e( t), then one will obtain a binary random series in which a pulse event will occur with a relative frequency proportional to the linear average of the measured value.

If two circuit arrangements from FIG. 4b are used and combined into a new arrangement, as in FIG. 7a, then one may achieve an analog-digital converter providing a binary random series in which a pulse even will occur with relative frequency that is proportional to the linear average of the product of the two measured values e (t) and e (t). This circuit arrangement operates in short as follows: similarly as in FIG. 4b, units 1a and 2a in FIG. 7a form a measured signal e,(t) which is passed on to converter 8a; the latter is also energized from the stochastic generator 4a and synchronizing resp. From the fundamental probability relation,

generator 7; the functional elements 4a and 8a are combined into one unit lla which will be called the random decision generator (RDG); RDG 11a is triggered by an impulse T and controlled by the measured signal e (t); in similar fashion, a measured signal is formed, which is e (t), by means of units lb and 2b which controls RDG 11b; at the outputs of RDG 11a or RDG 11b occur synchronized binary random series z (t or z (t these two binary random sequences for the sake of brevity will be termed Z and Z The threshold-value potentials v,(t) and v (t) being assumed statistically independent, then the random sequences Z and Z too will be statistically independent. If the sequences Z and Z are combined conjunctively by means of a combining network 10 into a new series Z, then according to the multiplication theorem of probability theory, the probability of a pulse in Z is equal to the product of the probabilities of a pulse in Z and Z Brief consideration will show that an antivalent combining of the binary series Z and Z is preferable, since then those constants will drop out, which are determined by the signal biases. The formation of the resultant series Z will therefore be explained in greater detail for the case of the antivalent connection.

If the probabilities for and l decisions at time t in the series Z are denoted by p, (O) and p (l) resp., then because of the similar notations for the corresponding probabilities in Z and Z for antivalent connection for series Z and Z into Z yields the following system of equations,

Because of previous simplification of decision, the threshold value potential v(t) was imparted the bias V and therefore v,( t) and v (t) show the biases V and V resp. In order to place the signals e (t) and e (t) into the modulation ranges corresponding to v,( t) and v (t) resp., it will be assumed for the sake of simplicity that the biases in e,(t) and e (t) are identical with V and V one obtains, assuming that p(v l/H that t lnax i The average relative frequency of occurrence for a pulse in series Z in the limiting case leads to infinite averaging of the corresponding probability p in the form h i T (t) t d Him T... 2T f-T l t and this expression is proportional to the average product of the measured signals e (t) and e t) except for a constant. If e (t) or (2 (2) are interpreted as being mag nitudes proportional to current or voltage, then p( l) is which receives measured signal e (t), is being clocked (triggered) by clock generator 7 so that RDG 11 generates a clocked binary random sequence 1 (1),). A logic network 12 is being clocked (triggered) by clock generator 7, too, so that a logic configuration of the binary random sequences z1( tk) and z (t is carried out only at predetermined clock instants t provided by the clock rhythm T of clock generator 7. Thereby a clocked binary random sequence z(t is delivered at the output of logic network 12.

According to FIG. 7c non-clocked RDGs lla and ll'b are being used. Only logic network 12" is clocked (triggered) by clock generator 7 (such as by connecting the clock generator output as an input to a multiple input logic gate together with other inputs z (t) and 2 (1)). Thereby in a similar manner as has been described in connection with FIG. 7b a clockedbinary random sequence z(t is delivered at the output of logic network 12". Logic network 12" and clock generator 7 together form a combining network 10'.

FIG. 7d shows a logic network 12" being controlled by two non-clocked binary random sequences z (t) and z t). Therefore logic network 12" at its output delivers a resulting non-clocked binary random sequence which is fed to a sampling network 6. Sampling network 6 is clocked (triggered) by a clock generator 7 and produces a clocked binary random sequence z(t,,). Logic network 112", sampling network 6 and clock generator 7 together form a combining network 10".

0 According to FlG. 7e two non-clocked binary random sequences z (t) and z (t) are fed to a sampling network 6a and a sampling network 6b, resp., both networks being clocked (triggered) synchronously by a clock generator 7. Thereby sampling network 6a produces a clocked binary random sequence z (t from binary random sequence z (t), and likewise sampling network 6b produces a clocked binary random sequence z (t from binary random sequence z (t). The clocked random sequences appear at the outputsof the respective sampling networks and are being configurated in a logic network 12 to a resulting binary random sequence z(t delivered at the output of logic network 12. Sampling networks 6a and 6b, clock generator 7, and logic network 12 cooperate in the manner described and together form a combining network 10'.

The circuit arrangements in FIGS. 7athrough 7e may be expanded for an arbitrary number of measured values. As a further illustration, the analogue-digital conversion for roots will now be explained in accordance with an application according to the invention, as it is obtained from time-averages.

FIGS. 8a and 8b illustrate the operation of the required circuit arrangements. The effective value of a measured value e(t) is the root of the mean square as Eq. (19) is evident because the analog-digital conversion concerning the value E amounts to the generation of a binary random series with a relative pulse frequency corresponding to p;;( l where 22. FIG. 8a shows the logical structure for the realization of this binary random series. RDGs 11a and 11b provide binary random sequences Z and Z which will be combined in the logic network 12a into the resultant output sequence Z, in which the relative pulse frequency corresponds to the probability p(l). A similar analogous circuit arrangement consists of RDGs lla and 11'!) and provides the binary random sequences Z and 2,. These will be combined in network 12 b into the resultant sequence Z. The input potential U of RDGs ll'a and llb is generated from a regulating circuit 13 controlled by the average potentials of sequences Z and Z. The potential average of the pulse series Z acts as command magnitude, that of Z as regulating magnitude. The regulating circuit 13 generates an adjusting value U which is fed back to RDGs ll'a and ll'b and is being kept fed back by regulating circuit 13 until the command and regulating magnitudes are the same. The nature of the circuit indicates that the probabilities for a pulse event in series 2;, and Z are the same. Let this probability be denoted by 12 (1). According to the multiplication theorem of probability theory, p;;( l) satisfies eq. (22) where p( l) is the relative pulse frequency in Z. Thus p (l) corresponds to the root of p( l The binary sequence 2., has the property of its pulse probability p l) yielding a value proportional to the magnitude E Lastly it should be noted that for e (t) being identical with e (t), p 1) is proportional to the effective value of the signal potential.

FIG. 8b shows a variation of the circuit or device 15, deriving from the random series Z and Z a regulating potential U It shows how Z and Z are being combined by means of an exclusive OR gate 16 into a resultant binary random series, in which a pulse event occurs with a probability that corresponds to the difference in pulse probabilities in Z and Z, assuming these are statistically coupled. The potential U corresponds to the reference value 0.

The resulting binary random sequence is fed to an averaging device 14 which therefrom forms a DC signal being fed as a regulating magnitude to a differential amplifier l3. Amplifier 13 compares said regulating magnitude with a voltage U which represents a zero reference and acts as a command magnitude. Differential amplifier 13 generates an adjusting magnitude U which, similar to the function of the circuit shown in FIG. 8a, is fed as input signal to RDGs ll'a and llb. Thereby devices 15 and 15 serve the same purpose.

In FIGS. 8a and 8b elements 14, 14a and 141; are similar elements having an averaging function with respect to time on signals appearing at their inputs which in the present case are the binary random sequences Z and Z. The symbol has been used to designate the function of elements and 14b. Possible embodiments of elements 14, 14a and 14b can be RC (integrating) networks or low pass filters belonging to the state of art. The regulator 13 may be a conventional differential amplifier as will be appreciated. Such differential amplifiers are well known in the art and have been available for many years, for example, as standard integrated circuits such as those known as type 709 or type 741.

FIG. 9 shows a further application of the circuit arrangement of the invention, consisting of the analogdigital conversion with the functional formation of quotients of time averages. The arrangement of FIG. 9 for the sake of simplicity is restricted to the application of quotient formation of the linear average of two signal functions e (t) and e (t). Channel 11a provides a binary random series Z which after time averaging in 14c will control as a command value the regulating circuit 13. RDGs 11 and 11b provide the series 2;, and Z which will be combined in logic network 12 into a resultant series Z, the combination being antivalent. The time average of Z" acts as the regulating magnitude for the regulating circuit 13. The adjusting magnitude U is fed back as an input potential to RDG 11' and will be adjusted till the pulse frequencies of occurrence in series Z and Z are the same. The relative pulse frequency in series Z then provides a magnitude which is proportional to the linear averages quotient of e,(t) and e (t), in conformity with the previously mentioned multiplication theorem of probability theory. The nature or structure of the circuit arrangement of FIG. 9 may be expanded for an arbitrary number of signal functions.

The correlation coefficient of statistical communication theory,

where ing to (1),,(0), (11 (0) according to eq. (19) and eq. (24) are derived from the input signals e (t) and c m) similarly to the signal processing shown in FIG. 7a. The time averages of series Z and Z act as command magnitudes for the regulating circuits 13 and 13. An arrangement 14b together with the logic network 12d provides the regulating magnitude for regulator 13, network l2ds functioning already having been described with respect to root forming. The regulating magnitude for regulator 13' is derived from the series Z which results from the logic combination in network 122 of the binary random series from RDGs 11' and llb. the input signals of the RDGs 11' and lll'b form the adjusting magnitudes U and U The regulating circuit 13 changes its adjusting magnitude U until the relative pulse frequency in random series Z is equal to that of Z. RDG 1 1 'b then provides a random series with a pulse frequency of occurrence that is proportional to the value (0) (0). On the other hand, the regulating circuit 13' changes its adjusting magnitude U until the relative pulse frequency in Z is equal to that in Z and hence proportional to (0). Thus RDG Ill provides a random series in which the pulses occur with a relative frequency proportional to p, frequency proportional to p.

The next application is an example of execution for the analog-digital conversion with functional DC values. The circuit arrangement is shown in FIGS. 11a and 11b, and the associated signal processing in FIG. 12.

The measured value e(t) is fed to units 3a and 3b in FIG. 1 1a which compare e(t) with their comparison potentials which are the saw-tooth potentials s(t) and -s(t). The latter are obtained from the threshold-value generator 4". FIGS. 12a through 120 show the decision diagram of units 3a and 3b and also their output pulse series Z and Z for the case of a saw-tooth-like threshold-value potential.

As shown in FIG. 12b, the unit 3a will provide a potential corresponding to the state logic 1 so long e(t) remains larger than the saw-tooth potential s(t), otherwise its output potential will correspond to the state logic 0.

Similar considerations apply to unit 3b with respect to FIG. 120. The series of potential changes at the outputs of units 3a and 3b each form one binary pulse sequence, the logic equivalents of which are denoted as Z, and Z resp. Mathematically, these conditions for unit 3a may be expressed as e(t) a s(t) Z :=1

e(t) s(t) Z,.=0

where s(t) s 0, and for unit 312 they may be expressed as 2(2) --s(t) Z :=l e(t) s(t) Z :=O

where s(t) s 0 Simultaneous consideration of the inequalities (25) and (26) shows that Z :=1 implies Z :=1 and that Z :=0 implies Z :=0. The two series Z and Z are com- 6 bined in FIG. 11a in a combining network 10, for instance an equivalence circuit, into a resultant 0-1- sequence Z. The following truth table holds for such kind of logic combining:

For the periodic signal e(t) shown in FIG. 12a in connection with a saw-tooth potential s(t) or s(t), the described logic decision or combining evolution means, when illustrated, that the pulse lengths z and Z2t(.F1,2. of series Z and Z are proportional to chords of slope :t S/ T s and s, which were cut out of the signal e(t) by the saw-tooth potentials s(t) and s(t) resp. If the signal e(t) and the saw-tooth potential s(t) are incommensurable with respect to their spectrum frequencies, the series Z will be made up of pulses the lengths 2,, of which on the average will correspond to all possible chords sf" of the positive signal parts, while the pulse lengths Z of Z in similar manner correspond to all possible chords sf of the negative signal parts. The relative frequency of occurrence of the state logic I in Z yields therefore a value proportional to the arithmetic mean of the positive signal parts, and the corresponding frequency in Z the corresponding value of the negative signal parts, though with a positive sign. After the equivalent combining of Z and Z into Z, one may see from FIG. 12d that the relative frequency of the state logic 1 in Z has a value proportional to the arithmetic mean of the absolute value of signal e(t). The former value corresponds to full-wave rectification of e(t). Thus there is a binary series in Z with the property of a relative state frequency for logic 1 and corresponding to the DC value of the measured signal e(t). FIG. lllb shows another possibility, an analog-digital conversion with functional rectification.

The last application to be discussed for the circuit arrangement according to the invention is the analogdigital conversion for transformed measured signals. Because of probability theory considerations, one may show that a converter, such as is shown with its control in FIG. I3, provides a binary series Z of which the relative pulse frequency corresponds to the time average of the measured signal e(t) which has been transformed by the amplitude spectrum p( v) of the threshold-value potential v( t). With respect to the mathematical background, the relevant literature is referred to. These relations also apply for a periodic potential v(t), in which case the amplitude spectrum P(v) may be stated in the form of its inverse function (v) It is evident from the representation of FIG. 13 that such a circuit arrangement may be extended to several input signals and to several function transforms.

What is claimed is:

l. Apparatus for converting analog electrical signals to a digital electrical signal wherein the statistical probability of a predetermined state for said digital signal is a predetermined function of said analog signals thus providing a digital representation of said analog signals that has improved digital transmission capabilities, said apparatus comprising:

source means for providing said analog electrical signals,

varying threshold signal generator means for providing a continuous threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values,

and

comparison and decision means having two inputs respectively connected to receive said analog electrical signals and said threshold electrical signal and an output for supplying said digital electrical signal which digital signal changes between distinct states as a function of a predetermined comparison made between the analog electrical signals and said threshold electrical signal whereby the statistical probability of existence for a predetermined state of said digital signal is a predetermined function of said analog signals corresponding to said predetermined statistical distribution of amplitude values in said continuous varying threshold electrical signal.

2. Apparatus as in claim 1 wherein said varying threshold signal generator means includes means for causing said predetermined statistical distribution of amplitude values to be a constant uniform distribution whereby the statistical probability of existence for said predetermined state of said digital signal is linearly related to the magnitude of said analog signals.

3. Apparatus as in claim 2 wherein said varying threshold signal generator means comprises a sawtooth signal generator.

4. Apparatus as in claim 2 wherein said varying threshold signal generator means comprises a stochastic signal generator for generating a continuous stochastically varying threshold signal.

5. Apparatus as in claim 1 wherein said varying threshold signal generator comprises a stochastic signal generator for generating a continuous stochastically varying threshold signal.

6. Apparatus as in claim 5 wherein said varying threshold signal generator includes means for causing the continuous stochastically varying threshold signal to correspond to a predetermined transform to be used with respect to said analog input signals.

7. Apparatus as in claim 5 wherein the stochastically varying threshold signal is statistically independent of said analog signals.

8. Apparatus as in claim I wherein said varying threshold signal generator means includes means for causing said predetermined statistical distribution of amplitude values to correspond to predetermined transform function to be applied to said analog signals.

9. Apparatus as in claim 1, wherein said comparison and decision means comprises an amplitude discriminator having two different output states depending on which input is greater than the other.

10. Apparatus as in claim 1 further comprising:

a synchronizing clock generator means for supplying periodic trigger signals, and wherein said comparison and decision means includes sampling means connected to be controlled by said trigger signals and to cause said digital electrical signals to comprise a sequence of pulses/no-pulses occurring at time intervals corresponding to the occurrence of said trigger signals.

1 1. Apparatus for converting analog electrical signals to a digital electrical signal wherein the statistical probability of a predetermined state for said digital signal is a predetermined function of said analog signals thus providing a digital representation of said analog signals that has improved digital transmission capabilities, said apparatus comprising:

first source means for providing a first analog electrical signal, first varying threshold signal generator means for providing a first continuous varying threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values, first comparison and decision means having two inputs respectively connected to receive said first analog electrical signals and said first threshold electrical signal and an output for supplying a first digital electrical output signal which digital signal changes between distinct states as a function of a predetermined comparison made between the first analog electrical signal and said first threshold electrical signal whereby the statistical probability of existence for a predetermined state of said first digital signal is a predetermined function of said first analog signal corresponding to said predetermined statistical distribution of amplitude values in said first continuous varying threshold electrical signal, second source means for providing a second analog electrical signal, second varying threshold signal generator means for providing a second continuous varying threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values, second comparison and decision means having two inputs respectively connected to receive said second analog electrical signal and said second threshold electrical signal and an output for supplying a second digital electrical output signal which digital signal changes between distinct states as a function of a predetermined comparison made between the second analog electrical signal and said second threshold electrical signal whereby the statistical probability of existence for a predetermined state of said second digital signal is a predetermined function of said second analog signal corresponding to said predetermined statistical distribution of amplitude values in said second continuous varying threshold electrical signal, and logic combining means connected to separately receive the digital signals from each of said first and second comparison and decision means and to produce a common digital output signal as a predetermined logical combination thereof whereby the probability of existence for a predetermined state of the common digital output is a predetermined function of the plurality of analog signals input to the apparatus. 12. Apparatus as in claim 11, further comprising: at least one synchronizing clock generator means for supplying periodic trigger signals, and wherein at least one of said comparison and decision means and said logic combining means includes sampling means connected to be controlled by said trigger signals and to cause said common digital output to comprise a sequence of pulse's/no-pulses occurring at time intervals corresponding to the occurrence of said trigger signals. 13. Apparatus as in claim 11 wherein the logic combining network comprises time averaging devices and and wherein the other input of the last-mentioned differential amplifier is connected to the output of a reference source.

15. Apparatus as in claim 11 wherein the logic combining circuit comprises a regulating circuit, the adjusted magnitude analog output of which is connected back as an analog input to at least one respectively corresponding comparison and decision means. 

1. Apparatus for converting analog electrical signals to a digital electrical signal wherein the statistical probability of a predetermined state for said digital signal is a predetermined function of said analog signals thus providing a digital representation of said analog signals that has improved digital transmission capabilities, said apparatus comprising: source means for providing said analog electrical signals, varying threshold sIgnal generator means for providing a continuous threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values, and comparison and decision means having two inputs respectively connected to receive said analog electrical signals and said threshold electrical signal and an output for supplying said digital electrical signal which digital signal changes between distinct states as a function of a predetermined comparison made between the analog electrical signals and said threshold electrical signal whereby the statistical probability of existence for a predetermined state of said digital signal is a predetermined function of said analog signals corresponding to said predetermined statistical distribution of amplitude values in said continuous varying threshold electrical signal.
 2. Apparatus as in claim 1 wherein said varying threshold signal generator means includes means for causing said predetermined statistical distribution of amplitude values to be a constant uniform distribution whereby the statistical probability of existence for said predetermined state of said digital signal is linearly related to the magnitude of said analog signals.
 3. Apparatus as in claim 2 wherein said varying threshold signal generator means comprises a saw-tooth signal generator.
 4. Apparatus as in claim 2 wherein said varying threshold signal generator means comprises a stochastic signal generator for generating a continuous stochastically varying threshold signal.
 5. Apparatus as in claim 1 wherein said varying threshold signal generator comprises a stochastic signal generator for generating a continuous stochastically varying threshold signal.
 6. Apparatus as in claim 5 wherein said varying threshold signal generator includes means for causing the continuous stochastically varying threshold signal to correspond to a predetermined transform to be used with respect to said analog input signals.
 7. Apparatus as in claim 5 wherein the stochastically varying threshold signal is statistically independent of said analog signals.
 8. Apparatus as in claim 1 wherein said varying threshold signal generator means includes means for causing said predetermined statistical distribution of amplitude values to correspond to predetermined transform functions to be applied to said analog signals.
 9. Apparatus as in claim 1, wherein said comparison and decision means comprises an amplitude discriminator having two different output states depending on which input is greater than the other.
 10. Apparatus as in claim 1 further comprising: a synchronizing clock generator means for supplying periodic trigger signals, and wherein said comparison and decision means includes sampling means connected to be controlled by said trigger signals and to cause said digital electrical signals to comprise a sequence of pulses/no-pulses occurring at time intervals corresponding to the occurrence of said trigger signals.
 11. Apparatus for converting analog electrical signals to a digital electrical signal wherein the statistical probability of a predetermined state for said digital signal is a predetermined function of said analog signals thus providing a digital representation of said analog signals that has improved digital transmission capabilities, said apparatus comprising: first source means for providing a first analog electrical signal, first varying threshold signal generator means for providing a first continuous varying threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values, first comparison and decision means having two inputs respectively connected to receive said first analog electrical signals and said first threshold electrical signal and an output for supplying a first digital electrical output signal which digital signal changes between distinct states as a function of a predetermined comparison made between the first analog electrical signal and said first threshold electrical signal whereby the statistical probability of existence for a predetermined state of said first digital signal is a predetermined function of said first analog signal corresponding to said predetermined statistical distribution of amplitude values in said first continuous varying threshold electrical signal, second source means for providing a second analog electrical signal, second varying threshold signal generator means for providing a second continuous varying threshold electrical signal having a predetermined statistical distribution of amplitude values over a predetermined range of values, second comparison and decision means having two inputs respectively connected to receive said second analog electrical signal and said second threshold electrical signal and an output for supplying a second digital electrical output signal which digital signal changes between distinct states as a function of a predetermined comparison made between the second analog electrical signal and said second threshold electrical signal whereby the statistical probability of existence for a predetermined state of said second digital signal is a predetermined function of said second analog signal corresponding to said predetermined statistical distribution of amplitude values in said second continuous varying threshold electrical signal, and logic combining means connected to separately receive the digital signals from each of said first and second comparison and decision means and to produce a common digital output signal as a predetermined logical combination thereof whereby the probability of existence for a predetermined state of the common digital output is a predetermined function of the plurality of analog signals input to the apparatus.
 12. Apparatus as in claim 11 further comprising: at least one synchronizing clock generator means for supplying periodic trigger signals, and wherein at least one of said comparison and decision means and said logic combining means includes sampling means connected to be controlled by said trigger signals and to cause said common digital output to comprise a sequence of pulses/no-pulses occurring at time intervals corresponding to the occurrence of said trigger signals.
 13. Apparatus as in claim 11 wherein the logic combining network comprises time averaging devices and differential amplifiers, the inputs of the differential amplifiers being connected to the outputs of corresponding time averaging devices'' outputs and wherein the outputs of said differential amplifiers are fed back as respectively corresponding varying threshold signals.
 14. Apparatus as in claim 11 wherein the logic combining network comprises time averaging devices, differential amplifiers and reference sources, wherein at least one of the inputs of a differential amplifier is connected with the output of one time-averaging device and wherein the other input of the last-mentioned differential amplifier is connected to the output of a reference source.
 15. Apparatus as in claim 11 wherein the logic combining circuit comprises a regulating circuit, the adjusted magnitude analog output of which is connected back as an analog input to at least one respectively corresponding comparison and decision means. 